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(54) Parking assist device and method for assisting parking 



(57) According to a parking assist device and a 
method for assisting parking of the invention, when a 
parking assist is canceled after a start of the parking as- 
sist, and the parking assist is restarted, a target parking 
position (P2B) is reset at a reset position (P1B). In the 
invention, at this time, the target parking position (P2B) 
is determined based on a target parking position (P2A) 
which is set at a parking preparation position (P1 A), and 
the determined target parking position (P2B) is dis- 
played on a screen of a monitor (4) as a default display 
position of a target parking frame (11) at a reset time. 
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Description 

BACKGROUND OF THE INVENTION 
Field of Invention 

[0001] The invention relates to a parking assist device 
and a method for assisting parking. 

Description of Related Art 

[0002] When a driver operates a vehicle, it is relatively 
difficult to park a vehicle such as backing the vehicle into 
the garage and executing parallel parking. Especially, a 
beginning driver is likely to have difficulty in a vehicle 
operation at the time of parking the vehicle. Then, a 
parking assist device for assisting the operation at the 
time of parking the vehicle is known. As the parking as- 
sist device of this type, a parking guide device is dis- 
closed in Japanese Patent Laid-Open Publication No. 
1 1 -208420. The parking guide device guides the vehicle 
to a target parking position by capturing a target parking 
area from a side of the target parking position and su- 
perimposing a target parking frame obtained by compu- 
tation on the captured camera image. 
[0003] However, in the parking guide device disclosed 
in the aforementioned publication, the parking assist 
may be canceled against the driver's will due to shock 
or the like which is caused when the vehicle runs onto 
a curbstone arranged in front of the garage. after the 
parking assist is started. In such a case where the park- 
ing assist is canceled against the driver's will, the driver 
usually wants the parking assist to be restarted soon. 
However, in the parking guide device disclosed in the 
Publication, a moving route of the vehicle is determined 
only depending on a relative positional relation between 
a position of the vehicle at which the target parking area 
is captured from the side, and the target parking area. 
Therefore, once the parking assist is canceled, the ve- 
hicle needs to be moved to the side of the target parking 
position again, which takes a lot of trouble. 

SUMMARY OF THE INVENTION 

[0004] It is an object of the invention to make it pos- 
sible to set a target parking position easily when parking 
assist is canceled because a vehicle stops or the like 
during the parking assist, and the parking assist is re- 
started. As a result, the parking assist can be restarted 
early. 

[0005] A first aspect of the invention relates to a park- 
ing assist device which includes image capturing means 
for capturing an area outside the vehicle and displaying 
means for displaying a captured image, and displays a 
target parking frame on a screen of the displaying 
means to assist an operation of parking executed by a 
driver. When the parking assist is canceled after the start 
thereof, and then the parking assist is restarted, the 



parking assist device determines a target parking posi- 
tion at the restart time of parking assist based on a target 
parking position which is set prior to the restart time of 
the parking assist, and displays the target parking posi- 
5 tion at the restart time on a screen of the displaying 
means as a default display position (initial setting posi- 
tion) of the target parking frame at the reset time. 
[0006] Therefore, a position corresponding to the tar- 
get parking position or a position close to this may be 
10 the default display position of the target parking frame. 
Accordingly, when the target parking position is set, the 
target parking frame is not required to be moved con- 
siderably, which enables an easy setting of the target 
parking position and an early restart of the parking as- 
15 sist. 

[0007] Also, it is preferable to determine the target 
parking position at the restart time of the parking assist 
by calculating a moving amount of the vehicle from when 
the target parking position is set prior to the restart of 
20 the parking assist until when the parking assist is restart- 
ed, and by moving the target position set prior to the 
restart time by the moving amount of the vehicle. 
[0008] The default display position of the target park- 
ing frame at the reset time can be easily determined by 
25 setting the default display position of the target parking 
frame at the reset time in the above-mentioned manner. 
[0009] Also, the target parking frame may be obtained 
based on the determined target parking position at the 
restart time, and the obtained target parking frame may 
30 be displayed as a default display on the screen. 

[001 0] In addition, it is preferable that the parking as- 
sist system is provided with restart judging means for 
judging whether a setting of the target parking position 
is for a restart of the parking to the target parking posi- 
35 tion which is set prior to the restart of the parking assist. 
If the setting of the target parking position is judged as 
for the restart of parking by the restart judging means, 
it is preferable to display the target parking frame ob- 
tained based on the target parking position at the restart 
40 time as the default display on the screen. 

[001 1 ] As mentioned above, the default display posi- 
tion of the target parking frame at the restart time of the 
parking assist can be easily set by providing the restart 
judging means. 
^5 [001 2] Also, it is preferable to keep displaying the tar- 
get parking frame on the screen of the displaying means 
during execution of the parking assist. 
[0013] The driver can confirm the position at which the 
vehicle is to be parked with reliability by continuously 
50 displaying the target parking frame during the parking 
assist. 

[0014] The parking assist device may include target 
parking position setting means for setting the target 
parking position by moving the target parking frame 
55 which is displayed on the screen on the displaying 
means. Accordingly, when the target parking frame is 
displaced from the target parking position at the restart 
time of the parking assist, the target parking frame can 
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be easily corresponds to the target parking position by 
the target parking position setting means. 
[0015] A second aspect of the invention relates to a 
method for assisting a parking operation by displaying 
an image captured by image capturing means of a ve- 
hicle and the target parking frame on a screen of dis- 
playing means provided inside the vehicle. In this meth- 
od, when the parking assist is canceled after the start 
thereof, and the parking assist is restarted, the target 
parking position at the restart time is determined based 
on the target parking position which is set prior to the 
restart of the parking assist. Subsequently, the deter- 
mined target parking position is displayed on the screen 
of the displaying means as the default display position 
of the target parking frame at the reset time. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] The forgoing and further objects, features and 
advantages of the invention will become apparent from 
the following description of preferred embodiment with 
reference to the accompanying drawings, wherein like 
numerals are used to represent like elements and 
wherein: 

FIG. 1 is a block diagram showing a parking assist 
device according to an embodiment of the inven- 
tion. 

FIG. 2 is a diagram showing an image displayed on 
a monitor. 

FUG. 3 is a plane view showing a state in which the 
vehicle moves to a target parking area. 
FIG. 4 is an explanatory view explaining the target 
parking position which is a relative position with re- 
spect to a parking preparation position. 
FIG. 5 is an explanatory view explaining a relation 
between the target parking position and a reset po- 
sition at which the target parking position is reset. 
FIG. 6 is a flow chart showing an operation of the 
parking assist device according to the embodiment. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENT 

[0017] Hereafter, a preferred embodiment of the in- 
vention will be explained in detail with reference to ac- 
companied drawings. 

[0018] A parking assist device 1 according to the em- 
bodiment is mounted on a vehicle to execute parking 
assist when the vehicle is parked. As shown in FIG. 1 , 
the parking assist device 1 includes a parking assist 
ECU 2, which is an electronic control unit. The parking 
assist ECU 2 controls the whole parking assist device 
1 . The parking assist ECU 2 is provided with a CPU, a 
ROM, a RAM, an input signal circuit, an output signal 
circuit, a power circuit, or the like, and stores various 
control routines including a parking assist control rou- 
tine. 



[0019] A camera 3, a monitor 4, and target parking 
position setting means 5 are connected to the parking 
assist ECU 2. The camera 3 can be regarded as image 
capturing means of the invention. The monitor 4 can be 

s regarded as displaying means of the invention. 

[0020] The camera 3 includes, for example, a wide- 
angle lens which is arranged in a rear portion or a side 
portion of the vehicle, and captures an image of an out- 
side area in back of the vehicle. The image captured by 

w the camera 3 is displayed on a screen of the monitor 4. 
The camera 3 may capture the image of the area in back 
of the vehicle at all the times, or may start capturing the 
image when the vehicle is backed up in order to reduce 
power consumption. Vehicle's backing up can be detect - 

15 ed by, for example, a fact that a shift lever is placed in 
a reverse range. 

[0021] The monitor 4 is arranged at a position, for ex- 
ample, at a position which is within sight of the driver, in 
an instrument panel. As shown in FIG. 2, a target park- 

20 ing frame 11 which shows a target parking position dis- 
played at a position determined by the parking assist 
ECU 2 in addition to the image captured by the camera 
3 is displayed on the screen of the monitor 4. 
[0022] As shown in FIG. 2, target parking position set- 

25 ting means 5 is a touch panel type and is displayed on' 
a screen of the monitor 4, and includes arrows Y1 to Y4 
in a vertical direction or a lateral direction, and rotational 
arrows Y5, Y6 which curve in a clockwise direction or a ' 
counterclockwise direction. By touching these arrows* 

30 Y1 to Y6, a target parking frame 1 1 which is determined 
in advance, and also displayed on the screen of the 
monitor 4 along with the image captured by the camera 
3 is rotated and moved to set the target parking position. 
Note that when a default position display of the target 

35 parking frame 11 corresponds to a position correspond- 
ing to the target parking position, the target parking po- 
sition is set without the need for touching the arrows Y1 
to Y6 of the target parking position setting means. 
[0023] Also, a determining switch S1 which the driver 

40 touches when the driver judges that the default position 
display of the target parking frame 11 has corresponds 
to the position corresponding to the target parking posi- 
tion, and an assist canceling switch S2 which the driver 
touches when the driver wants to cancel parking assist 

^5 in midstream are displayed on the screen of the monitor 
4. The parking assist is started by touching the deter- 
mining switch S1 , and the parking assist is canceled by 
touching the assist canceling switch S2. 
[0024] Further, as shown in FIG. 1 , automatic steering 

50 means 6 and a starter switch 7 for switching ON/ OFF 
of parking assist mode are connected to the parking as- 
sist ECU 2. The automatic steering means 6 is provided 
with an actuator for steering a steering wheel of the ve- 
hicle, and receives a control signal from the parking as- 

55 sist ECU 2 to steer the steering wheel. Also, the starter 
switch 7 is mounted on, for example, the instrument pan- 
el. In a state where the starter switch 7 is ON, when an 
assist start condition is established, that is, for example, 
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when the shift lever (not shown) is put into the reverse 
range, a mode is switched to the parking assist mode to 
start certain processing of the parking assist. Alterna- 
tively, in a state where the starter switch 7is OFF, even 
when the shift lever is put into the reverse range and the 
assist start condition is established, the mode is not 
switched to the parking assist mode and the processing 
of the parking assist is not executed. Therefore, for ex- 
ample, when the driver is skilled enough and does not 
need to use such parking assist device 1 , the starter 
switch 7 may remain OFF. 

[0025] Also, a vehicle speed sensor and a steering 
angle sensor 9 are connected to the parking assist ECU 
2. The vehicle speed sensor includes, for example, an 
active wheel speed sensor which is mounted on a wheel 
(not shown) of the vehicle, and detects a rotational 
speed of the wheel to output a speed signal to the park- 
ing assist ECU 2. In the parking assist signal ECU 2, a 
mileage of the vehicle is calculated based on the speed 
signal output from the vehicle speed sensor. Also, the 
steering angle sensor 9 is mounted on, for example, a 
steering shaft (not shown) of the vehicle, detects a ro- 
tation angle of a steering, and outputs a detected rota- 
tion angle signal to the parking assist ECU 2. In the park- 
ing assist ECU 2, a steering angle of the steering wheel 
is calculated based on the detected rotation angle signal 
of the steering. 

[0026] An operation of the parking assist device ac- 
cording to the embodiment will be explained, as follows. 
[0027] In the embodiment, as shown in FIG. 3, an ex- 
ample in which a vehicle M is parked into a parking sec- 
tion D2 of a parking lot PA whose area for parking vehi- 
cles is partitioned into parking sections D1, D2, D3, ». 
by a partitioning line will be explained. 
[0028] In a state where the starter switch 7 is ON, 
when a driver of the vehicle M, with the intention of park- 
ing the vehicle into the parking section D2, passes in 
front of the target parking position, turns the vehicle such 
that a rear portion of the vehicle M faces the parking 
section D2 to move the vehicle M to a parking prepara- 
tion position P1 , and puts the shift lever (not shown) in 
a vehicle compartment into the reverse range, the mode 
is switched to the parking assist mode. When the mode 
is switched to the parking assist mode, the camera 3 is 
turned ON first, and an image of an area in back of the 
vehicle is read by the camera 3. The image read by the 
camera 3 is output to the monitor 4 through the parking 
assist ECU 2, and displayed on the screen of the monitor 
4, as shown in FIG. 2. When the image is displayed on 
the screen of the monitor 4, a target parking position P2, 
shown in FIG. 3, in a longitudinal rectangular shape 
which is corresponding to a form obtained when the ve- 
hicle M is seen from the top is set. 
[0029] In order to set the target parking position P2, 
a target parking frame 1 1 is displayed at a default display 
position on the screen of the monitor 4 first. The driver 
touches the arrows Y1 to Y6 in the target parking posi- 
tion setting means 5 as required while looking at the tar- 



get parking frame 11 , to move the target parking frame 
11 , and ultimately set the target parking position P2. In 
the embodiment, when the default position of the target 
parking frame 11 at this time is determined, a computa- 
5 tion for estimating the target parking position P2 (a rel- 
ative position with respect to the parking preparation po- 
sition P1) is executed, and the default position of the 
target parking frame 11 is determined based on the es- 
timated target parking position P2. The target parking 
10 position P2 is estimated based on a running state of the 
vehicle which is obtained before the vehicle M reaches 
the parking preparation position P1 . 
[0030] When the parking operation is executed, a be- 
havior of the vehicle M before reaching the parking prep- 
's aration position P1 is usually as shown in FIG. 3. First 
the vehicle M comes close to a position in front of the 
parking section D2 where the driver intends to park the 
vehicle, while moving straight ahead. A moving direction 
of the vehicle M at this time is usually along a width di- 
20 rection of the parking section 02. Secondary, the vehicle 
M passes in front of the parking section D2. At this time, 
from a starting point Q which is at a front position of the 
parking section D2, the vehicle M turns and moves, for 
example, in a clockwise direction to the parking prepa- 
ys ration position P1 while proceeding in a direction of mov- 
ing away from the parking section D2 by a certain de- 
flection angle (a turning round angle with respect to an 
immediately preceding direction of moving straight) with 
a certain turning radius. Next, the vehicle M turns and 
30 moves while backing up in the clockwise direction with 
the certain turning radius. Then, the vehicle M finally 
straight backs up to the target parking position P2. 
[0031] The target parking position P2, which is a rel- 
ative position with respect to the parking preparation po- 
35 sition P1 , is estimated based on a running state (a track 
of the vehicle) by such a regular backing of a vehicle 
into a garage. More specifically, the target parking po- 
sition P2 is estimated as follows; assuming that the ve- 
hicle M moves straight and turns around so as to exe- 
40 cute such a regular parking as mentioned above when 
the vehicle M moves to the parking preparation position 
P1 , a deflection angle 8 (refer to FIG. 4) of the vehicle 
M is determined from the moving distance and the turn- 
ing radius of the vehicle, while the vehicle is turning. The 
45 moving distance is determined based on a signal from 
the vehicle speed sensor, and the turning radius is de- 
termined from an amount of steering of the steering 
wheel which is determined based on a signal from the 
steering angle sensor 9. 
so [0032] In this case, assuming that a minute moving 
distance and the turning radius of the vehicle M while 
the vehicle is turning are respectively ds and R, the de- 
flection angle 6 is determined by a following formula (1 ). 
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e= Ji//?-ds - (I) 
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[0033] In the formula (1), an integration interval is -5 
to 0 m. A variation of a direction of the vehicle which is 
caused by the vehicle's moving by 5m until the vehicle 10 
reaches the present position is determined by the for- 
mula. The moving distance, i.e., 5m may be changed in 
accordance with a vehicle speed as required. Also, the 
parking assist ECU 2 executes a straight judgement. 
When it is judged that the vehicle M has moved straight is 
as a result of the straight judgement, the deflection angle 
e, which is determined by the formula (1), is cleared. In 
the straight judgement, for example, when the vehicle 
has run for 2 m, for example, with a steering maintained 
substantially straight (a steering angle of the steering is 20 
within ± 30 degrees), it is judged that the vehicle has 
run straight. Therefore, when the vehicle moves straight 
before starting turning, the deflection angle 6 is accu- 
rately determined. 

[0034] After the deflection angle G is determined, the 25 
target parking position P2 ($1 , X1 , Z1) is determined in 
an X-Y coordinate system whose X-axis and Z-axis are 
respectively a lateral direction and a longitudinal direc- 
tion of the vehicle M with respect to a position of the 
vehicle M, as shown in FIG. 4. In this case, <J> is an angle so 
of moving toward a direction of turning, which is ob- 
tained when the vehicle M executes the parking opera- 
tion. Also, a coordinate system in which the target park- 
ing position P2 ((J> 1 , X1 , Z1 ) is shown is referred to as 
a road coordinate system. Formulas for calculating the 35 
target parking position P2 (<J> 1 , X1 , Z1) vary depending 
on degrees of the deflection angles 6. 
[0035] First, when the deflection angle G is equal to or 
larger than 0 and less than 30 degrees (0 £ 0 < 30), an 
amount <J> 1 of moving in the turning direction, an amount 40 
X1 of moving in the X direction, and an amount Z1 of 
moving in the Z direction are determined by following 
formulas (2) to (4). 

4>i=90°-e (2) 45 

X1 = Rmin • (1 .0 - sin 6) + B • cos G (3) 

so 

Z1 = C + Rmin - cos G + B ♦ sin 6 (4) 

[0036] Note that following are adaptation constants; 
Rmin = 4.05 (m), B = 2.0 (m), C = 1 .0 (m). ss 
[0037] When the vehicle is backed into the garage, 
the track of the vehicle can usually be set on the as- 
sumption that first the vehicle backs up straight, then 



moves back while turning, and backs up straight again. 
The adaptation constant B corresponds to the vehicle's 
last straight backing up, and the adaptation constant C 
corresponds to the vehicle's first straight backing up so 
as to obtain such a track. Also, the adaptation constant 
Rmin is a turning radius which is obtained when the ve- 
hicle backs up while turning, and, for example, a turning 
radius which is obtained when steering is made to the 
fullest extent. These adaptation constants are set based 
on an entire length, a full width, a wheel base, other fea- 
tures, or the like of the vehicle M, as required. 
[0038] When the vehicle moves, a moving amount in 
the X direction at the time of first straight backing up is 
0, a moving amount in the X direction at the time of back- 
ing up while turning around is Rmin • (1 .0 - sin G), and a 
moving amount in the X direction at the time of last 
straight backing up is B cos G. Therefore, as a moving 
amount X1 in the X direction, the formula (3) is derived 
by adding these values. Also, a moving amount in the Z 
direction at the time of first straight backing up is C, a 
moving amount in the Z direction at the time of backing 
up while turning is Rmin • cos 0, and a moving amount 
in the Z direction at the time of last straight backing up 
is B sin 0. Therefore, as a moving amount Z1 in the Z 
direction, the formula (4) is derived by adding these val- * 
ues together. 

[0039] Note that when the deflection angle G is 0 de- 
gree (G = 0), it is preferable to set in advance whether a v ' 
target parking frame 11 is displayed on a right side or ; 
left side of the vehicle on the screen of the monitor based 
on whether the vehicle M is parked on a right rear side 
or a left rear side, since the vehicle M does not turn 
around. 

[0040] Secondly, when the deflection angle G is eq ual 
to or larger than 30 degrees and less than 50 degrees 
(30 < G < 50), a moving amount <J>1 in the turning direction "* 
and a moving amount X1 in the X direction can be de- 
termined by the formula (2) and the formula (3) as well 
as in the case where the deflection angle is equal to or 
larger than 0 degree and less than 30 degrees. Also, an 
moving amount Z1 in the Z direction can be determined 
by the following formula (5). 

Z1 = 5.5 + 0.05 - (G - 30) (5) 

[0041] When the deflection angle G is equal to or larg- 
er than 30 degrees, the moving amount Z1 in the Z di- 
rection increases proportionately with the deflection an- 
gle G. Accordingly, within a range where the deflection 
angle G is equal to or larger than 30 degree and less 
than 50 degrees, the moving amount Z1 in the Z direc- 
tion linearly increases in accordance with increases in 
the deflection angle G, as shown by the formula (5). 
[0042] In addition, when the deflection angle G is 
equal to or larger than 50 degrees (50 < G), the moving 
amount $1 in the turning direction and the moving 
amount X1 in the X direction can be determined by the 
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formula (2) and the formula (3) as in the case where the 
deflection angle 0 is equal to or largerthan 0 degree and 
less than 30 degrees. Also, the moving amount Z1 in 
the Z direction can be determined by a following formula 
(6). 

Z1 = 6.5 (6) 

[0043] When the vehicle is backed to the garage, the 
deflection angle 6 is usually approximately 20 degrees, 
and even when the deflection angle 0 is large, it is ap- 
proximately 30 degrees. Also, when the deflection angle 
0 increases to equal to or largerthan 50 degrees, there 
is almost no variations in the moving amount in the Z 
direction. The target parking position P2 (<J> 1, X1, Z1) 
which is a relative position with respect to the parking 
preparation position P1 can be estimated with substan- 
tially high accuracy by fixing the moving amount Z1 at 
6.5 m and defining a maximum value. 
[0044] After the target parking position P2 is estimat- 
ed in the above-mentioned manner, the default display 
position of the target parking frame 11 is determined 
based on the estimated target parking position P2. So 
far, a relation between the parking preparation position 
P1 and the target parking position P2 has been ex- 
plained in the road coordinate system. However, a con- 
version from the road coordinate system to a monitor 
coordinate system is required in order to display the tar- 
get parking frame 11 on the screen of the monitor 4 
based on the target parking position P2. Therefore, a 
conversion from the target parking position P2 in the 
road coordinate system to the default display position of 
the target parking frame 11 in the monitor coordinate 
system will be explained as follows. 
[0045] First, coordinates of four points (points corre- 
sponding to four corners of the target parking frame 11) 
positioned at vertexes of the target parking position are 
determined based on the target parking position P2 
1 , X1 , Z1 ) in the road coordinate system which is deter- 
mined in the above-mentioned manner. Secondary, po- 
sitions of first midpoints of the target parking position P2 
are determined based on the coordinates of these ver- 
tex portions. Then, positions of second midpoints be- 
tween each first midpoint and each vertex are deter- 
mined, and positions which quarter a distance between 
each vertex are determined. Namely, three midpoints 
are determined between each vertex, and 12 midpoints 
are determined in total. 

[0046] The coordinates of the four vertexes and the 
12 midpoints determined in the above-mentioned man- 
ner are converted from the road coordinate system into 
the monitor coordinate system by a certain computing 
equation. At this time, only a position of an eye point is 
converted, and distortion of lens is not added. Then, the 
target parking frame 1 1 is displayed at the default dis- 
play position by adding the distortion of lens to the co- 
ordinate in the monitor coordinate system in accordance 



with the distortion of lens, determining four vertexes and 
12 midpoints, and connecting the four vertexes such 
that each side of the frame passes through these mid- 
points as required. 
5 [0047] When the target parking frame 1 1 is displayed 
at the default display position on the screen of the mon- 
itor 4 in the above-mentioned manner, the driver touch- 
es the arrows Y1 to Y6 in the target parking position set- 
ting means 5 as required to modify the position of the 
10 target parking frame 1 1 and set the target parking posi- 
tion. The target parking frame 11 is displayed in the vi- 
cinity of the target parking position P2 at this time, which 
reduces a setting time when the driver sets the target 
parking position P2. 
15 [0048] When the target parking position P2 is set, the 
parking assist ECU 2 judges whether a track from the 
parking preparation position P1 to the target parking po- 
sition P2 can be drawn based on a relative positional 
relation between the parking preparation position P1 , 
20 which is a current position of the vehicle M, and the set 
target parking position P2. Then, when the parking as- 
sist ECU 2 judges that the track cannot be drawn, it dis- 
plays the target parking frame 11 in red as well as dis- 
playing a comment "guidance is not available" on the 
25 screen of the monitor 4. On the contrary, when the park- 
ing assist ECU 2 judges that the track can be drawn, it 
displays the target parking frame 11, for example, in 
green which is different from red as well as displaying a 
determining switch S1 on the screen of the monitor 4. 
30 At this time, the target parking frame 11 is displayed at 
a position corresponding to the target parking position 
P2 on the screen of the monitor 4, and a traveling track 
12 of the vehicle until the vehicle reaches the target 
parking frame 1 1 is displayed on the screen of the mon- 
35 itor 4. The driver can confirm a route which the vehicle 
M takes from now by visually checking the traveling 
track 12. Also, when there is an obstacle or the like on 
the route, the driver can move the vehicle from the park- 
ing preparation position P 1 by touching an assist can- 
40 celing switch S2 to cancel the parking assist. Alterna- 
tively, when there is no obstacle or the like on the route, 
and the drivers judges that parking is possible, the park- 
ing assist is started by touching the displayed determin- 
ing switch S1, without touching the assist canceling 
45 switch S2. 

[0049] When the parking assist is started, the auto- 
matic steering means 6 is activated, which enables the 
driver to execute the parking operation with the parking 
assist by adjusting a vehicle speed as required, without 
50 operating the steering. During the execution of the park- 
ing assist, since the target parking frame 11 is continu- 
ously displayed on the screen of the monitor 4, the driver 
can execute the parking operation while confirming that 
the vehicle is moving toward target parking frame 11 on 
55 the screen of the monitor 4. 

[0050] There is a possibility that the parking assist is 
canceled because the vehicle stops or the like by fulfill- 
ing the assist canceling condition against the driver's 
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will. This may be caused when the vehicle runs onto a 
curbstone or the like, tn such a case, the driver usually 
needs to reset the target parking position P2 in order to 
restart the parking assist. In the embodiment, when the 
target parking position P2 is reset, the target parking 5 
frame 1 1 determined based on the previous target park- 
ing position P2 and the running state of the vehicle from 
when the parking assist is started until when the parking 
assist is canceled is displayed as a default display on 
the screen of the monitor 4. In such a case where the io 
parking assist is canceled against the driver's will, the 
vehicle M usually does not deviate from the traveling 
track. In such a case, the target parking frame 11 can 
be displayed without deviating from the reset target 
parking position P2 by displaying the target parking 15 
frame 11 which is determined in the above-mentioned 
manner as the default display on the screen of the mon- 
itor 4. This eliminates the driver having to re-execute a 
setting operation of the target parking position P2, or 
saves the driver the trouble of executing the setting op- 
eration. 

[0051] Hereafter, procedures of resetting the target 
parking position will be explained mainly with reference 
to FIG. 5. When the target parking position P2 which is 
set prior to the restart time of the parking assist is dis- 
played as the default display position of the target park- 
ing frame 11 (FIG. 2) at the restart time of the parking 
assist, a position to which the target parking frame 11 is 
moved by a moving amount from the target parking po- 
sition P2A which is set at the start time of the parking 
assist to the target parking position P2B which is set at 
the restart time of the parking assist may be the default 
display position of the target parking frame 11 at the re- 
set time. In FIG. 5, the parking preparation position that 
is a position at which the target parking position is set 35 
first is shown as P1 A, and the coordinate system with 
respect to the parking preparation position P 1 A is shown 
as a Xa - Za coordinate system. Also, a position at which 
the target parking position is reset is shown as P1 B, and 
the coordinate system with respect to the reset position 40 
P1 B is shown as Xb - Zb. Also, the target parking posi- 
tion in the Xa -Za coordinate system is shown as P2A, 
and the target parking position in the Xb - Zb is shown 
as P2B. Note that the target parking positions P2A, P2B 
are shown at an agreed position in FIG. 5. 45 
[0052] As shown in FIG. 5, referring to a moving angle 
of turning direction of the vehicle M as AcJ>, a moving 
amount of the vehicle M in a direction of an axis Xa as 
AX, and a moving amount of the vehicle M in a direction 
of an axis Zb as AZ respectively, a moving amounts so 
AX, AZ) of the vehicle M from the parking preparation 
position P1A to the reset position P1B are respectively 
determined by the following formulas (7) to (9). 
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9= jl/R ds •" (7) 

-0 

0 

AX= Jsin/9-ds -(8) 
o 

AZ= jcosO' ds — (9) 

-5.0 



[0053] In this case, an integral interval -0 to 0 is a mov- 
ing distance of the vehicle from the parking preparation 
position P1 A to the parking assist cancellation position 
(reset position P1B). 

[0054] The target parking position P2B (<|>2, X2, Z2) at 
the reset time is determined based on the moving 
amount (A(j>, AX, AZ) determined by the formulas (7) to 
(9), and the target parking position P2 ($1 , X1, Z1) de- 
termined at the parking preparation position P1 A which 
is determined by the formulas (2) to(6), by the following 
formulas (10) to (12). 



$2 = $1 - A<|> 



X2 = X1 - AX 



Z2 = 21 - AZ 



(10) 



(11) 



(12) 



[0055] Note that the target parking position P2B de- 
termined in the above-mentioned manner is a position 
in the Xa - Za coordinate system with respect to the park- 
ing preparation position P1 A. Therefore, the target park- 
ing position P2B is not a correct value for the vehicle M 
which is at the reset position P1 B. Accordingly, it is nec- 
essary to convert the P2B from the Xa - Za coordination 
system with respect to the parking preparation position 
P1 A to the Xb - Zb coordination system with respect to 
the reset position P1B, in order to determine a correct 
value. Showing the target parking position P2B after the 
conversion by coordinate points ($3, X3, Z3), the target 
parking. position P2B (4>3, X3, Z3) are respectively de- 
termined by the following formulas (13) to (16). 



<J>3= <j>2 



X3 = V*2 2 +22 2 - sin(a • 



A*) 



(13) 



(14) 
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Z3 = JX2 2 + Z2 2 . cos (a - A$) (15) 

a = cos" 1 (Z2 / VX2 2 + 22 2 ) (1 6) * 

[0056] The target parking frame 11 can be displayed 
at a substantially accurate position by converting the tar- 
get parking position P2B (<j>3, X3, 23), which is deter- 
mined in the above-mentioned manner, from the road 
coordinate system to the monitor coordinate system, 
and using the converted position as the default display 
position of the target parking frame 11 . The target park- 
ing frame 11 displayed at the default display position 
corresponds to the target parking position P2, or even 
when the target parking frame 11 deviates from the tar- 
get parking position P2, an amount of deviation is 
minute. Accordingly, when setting the target parking po- 
sition P2 at the restart time of the parking assist, the 
driver does not need to move the target parking frame 
1 1 , or even when the driver needs to move the target 
parking frame 11 , the moving amount may be minute. 
This saves the driver the trouble of setting the target 
parking position P2. Thus, the time required to set the 
target parking position may be eliminated or reduced. 
[0057] Also, the parking assist device 1 according to 
the embodiment executes different processing depend- 
ing on whether or not the parking assist is restarted by 
judging whether the parking assist is restarted or not. 
Hereafter, an operation thereof will be explained with 
reference to a flow chart shown in FIG. 6. 
[0058] In the parking assist device, first, whether a 
parking assist control is ON is judged (S1). When it is 
judged that the parking assist control is ON, then wheth- 
er the parking assist control is completed or not is judged 
(S2). Then, if the parking assist control is completed, the 
parking assist device judges that the parking assist con- 
trol is OFF and does not execute the parking assist (S8). 
If the parking assist control is not completed, the parking 
assist device judges that the parking assist control is 
ON, and continues the parking assist control (S7). 
[0059] Also, in step S1 , when it is judged that the park- 
ing assist control is OFF, then whether the parking assist 
control is being suspended or not is judged (S3). Wheth- 
er the parking assist control is being suspended or not 
can be judged, for example, by detecting a time elapsed 
since the vehicle M stopped after the vehicle M had 
started backing up by putting the shift lever of the vehicle 
M into the reverse range. At this time, if it is judged that 
the parking assist control is being suspended, whether 
the parking assist control is restarted or not is judged 
(S4). A determination on whether the parking assist con- 
trol has been restarted can be effected, for example, as 
follows. That is, a restart switch is displayed on the mon- 
itor while the parking assist operation is being suspend- 
ed and it is determined that the parking assist control 
has been restarted when the switch has been touched. 



[0060] Then, when the parking assist control is a re- 
started one, the default display position of the target 
parking frame 11 is determined by the formulas (7) to 
(1 6) based on the target parking position P2 which is set 
prior to the restart, as mentioned above (S5). Then, the 
driver moves the target parking frame 11 displayed at 
the default display position by touching the arrows Y1 
to Y6 in the target parking position setting means 5 as 
required (S6). After this, the target parking position P2 
is established by touching the determining switch S1 . 
However, at this time, the default display position of the 
target parking frame 11 substantially corresponds to a 
position corresponding to the target parking position P2, 
as mentioned above, which usually makes an adjust- 
ment operation unnecessary. Then, the parking assist 
control is turned ON by the driver's touching the deter- 
mining switch S1 (S7), and the parking assist control is 
continued. Also, when it is judged that the parking assist 
control is not restarted, the parking assist control is 
turned OFF (S8), and the parking assist control is not 
executed. 

[0061] Meanwhile, when it is judged that the parking 
assist control is not being suspended in step S3, wheth- 
er the parking assist control is started is judged (S9). 
Whether the parking assist control is started or not can 
be judged by, for example, detecting whether the shift 
lever is put into the reverse range or not, as mentioned 
above. When it is judged that the parking assist control 
is started, the target parking position P2 is estimated, 
for example, based on the running state which is detect- 
ed before the vehicle M reaches the parking preparation 
position P1 , as mentioned above, and the default dis- 
play position of the target parking frame 11 is deter- 
mined by the formulas (1 ) to (6) based on the estimated 
target parking position P2 (S10). The target parking 
frame 1 1 is displayed at the determined default display 
position, and then the driver moves the target parking 
frame 11 displayed at the default display position as re- 
quired by touching the arrows Y1 to Y6 in the target park- 
ing position setting means 5 to modify the target parking 
frame 11 (S11). Then, the target parking position P2 is 
established by touching the determining switch S1 . After 
this, the parking assist control is turned ON by the driv- 
er's touching the determining switch S1 (S7), and the 
parking assist control is continued. Alternatively, when 
it is judged that the parking assist control is not started 
in step S9, the parking assist control is turned OFF (S8), 
and the parking assist control is not executed. 
[0062] As mentioned above, at the restart time of the 
parking assist, the target parking frame 11 can be dis- 
played as the default display at a position corresponding 
to the target parking position P2 with high accuracy by 
judging whether the currently executed parking assist is 
the restarted parking start or not. 
[0063] While the preferred embodiment of the inven- 
tion has been explained, the invention is not limited to 
the above-mentioned embodiment. For example, in the 
above-mentioned embodiment, the target parking pOSi- 
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tion which is set first is exemplified as a target parking 3. 
position which is set prior to the restart of the parking 
assist. However, for example, when the parking assist 
has restarted twice or more, the target parking position 
which is set most recently may be the target parking po- 5 
sition which is set prior to the restart of the parking as- 
sist. As a matter of course, when the parking assist has 
been restarted twice or more, the target parking position 4. 
which is set first may be the target parking position set 
prior to the restart of the parking assist. 10 
[0064] Also, in the embodiment, automatic steering 
means is provided. However automatic braking means 
or automatic driving means in addition to the automatic 
steering means may be provided such that the driver 
can execute the parking operation without executing a is 
vehicle speed adjustment operation. As a matter of 
course, one or two of the above-mentioned means may 
be provided such that the driver can execute the parking 
assist. 

[0065] As explained above, according to the embod- 20 5. 
iment, when the parking assist is cancelled during the 
parking assist execution because the vehicle stops or 
the like, and the parking assist is restarted, the target 
parking position can be easily set, which enables an ear- 
ly start of the parking assist after the restart. 25 



Claims 

1. A parking assist device which is provided with im- so 
age capturing means (5) for capturing an image of 

an area outside the vehicle, and displaying means 
(4) for displaying the captured image, and displays 
a target parking frame (11) on a screen of the dis- 
playing means (4) to assist a parking operation ex- 35 
ecuted by a driver of the vehicle characterized in 
that 

when a parking assist is canceled after a start 
of the parking assist, and the parking assist is re- 
started, the parking assist device determines a tar- 40 
get parking position (P2B) at a restart time of the 
parking assist based on a target parking position 
(P2A) set prior to the restart time of the parking as- 
sist, and displays the determined target parking po- 
sition (P2B) on the screen of the displaying means 45 
(4) as a default display position of the target parking 
frame (11 ) at a reset time. 

2. The parking assist device according to claim 1, 
characterized in that so 

a moving amount (A4>, AX, AZ) of the vehicle 
obtained from when the target parking position 
(P2A) is set prior to the restart time of the parking 
assist until when the parking assist is restarted is 
determined, and the target parking position (P2B) 55 
at the restart time is determined by moving the tar- 
get position (P2A) set prior to the restart by the mov- 
ing amount of the vehicle. 



The parking assist device according to claim 1 or 2, 
characterized in that 

the target parking frame (11) determined 
based on the target parking position (P2B) at the 
restart time is displayed as a default display on the 
screen. 

The parking assist device according to claim 3, 
characterized in that 

the parking assist device further comprise re- 
start judging means forjudging whether a setting of 
the target parking position (P2) is a setting of the 
target parking position (P2B) at the restart time, and 

the target parking frame (11) is displayed as 
the default display on the screen when the setting 
of the target parking position is judged as the target 
parking position (P2B) at the restart time by the re- 
start judging means. 

The parking assist device according to any one of 
claims 1 to 4, characterized in that 

the target parking frame (11) is displayed on 
the screen of the monitor (4) during execution of the 
parking assist. 

The parking assist device according to claim 5, 
characterized by further comprising: 

target parking position setting means (5) which 
includes a portion operated by a driver of the 
vehicle so as to move the target parking frame 
(11 ) displayed on the monitor (4) on the screen, 
and a portion operated by the driver so as to 
set the displayed target parking frame (11) as 
the target parking position (P2). 

A method for assisting a parking operation by dis- 
playing an image captured by image capturing 
means (5) of a vehicle and a target parking position 
(11) on a screen of displaying means (4) provided 
inside the vehicle characterized in that 

when a parking assist is canceled after a start 
of the parking assist, and the parking assist is re- 
started, a target parking position (P2B) at the restart 
time is determined based on a target parking posi- 
tion (P2A) which is set prior to the restart time of the 
parking assist, and the determined target parking 
position (P2B) is displayed on the screen of the dis- 
playing means (4) as a default display position of 
the target parking frame (11) at a reset time. 



9 



EP 1 332 948 A1 



F I G .1 



DRIVER 



XT 



sw 



'XT 



CAMERA 



8- 



VEHICLE 
SPEED 
SENSOR 



STEERING 
ANGLE 
SENSOR 



PARKING TARGET 

POSITION 
SETTING MEANS 



PARKING 
ASSIST 
ECU 



AUTOMATIC 
STEERING 
MEANS 



MONITOR 



V 



10 



EP 1 332 948 A1 




11 



EP 1 332 948 A1 




EP 1 332 948 A1 



F I G . 4 




EP 1 332 948 A1 



FI G . 5 



01 



Rmin 



A4>, 



P2(P2A,P2B) 




X3 



Zb 



14 



EP 1 332 948 A1 




EP 1 332 948 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP G3 00 0010 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, when? appropriate, 
oi relevant passages 



Releva nt 
to claim " 



CLASSIFICATION OF THE 
APPLICATION (lnt.Cl7) 



X,D 



PATENT ABSTRACTS OF JAPAN 

vol. 1999, no. 13, 

30 November 1999 (1999-11-30) 

-& JP 11 208420 A (NISSAN MOTOR CO LTD), 

3 August 1999 (1999-08-03) 

* abstract * 

US 5 957 232 A (SHIMIZU YASU0 ET AL) 
28 September 1999 (1999-09-28) 

* column 2, line 22-51; claims 1,4,5,8; 
figure 1 * 

EP 1 170 171 A (TOYOTA MOTOR CO LTD ;AISIN 
SEIKI (JP) ) 9 January 2002 (2002-01-09) 

* column 1, line 56 - column 3, line 6; 
claims 1-3,7,8; figures 1,2 * 



1,3,5-7 



B62D15/00 
B6001/48 



1-7 



1-7 



TECHNICAL FIELDS 
SEARCHED (IM.C1.7) 



B62D 

B60Q 



The present search report has been drawn up tor all claims 



Place ol search 

BERLIN 



Date of completion of the search 

31 March 2003 



Matos Goncalves, M 



CATEGORY OF CITED OOCUMENTS 



X : particularly relevant if taken aJone 
Y : particularly relevant if combined with 

document of the same category 
A : technological background 
O : non-written disclosure 
P : Intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document cited in the application 
L : document cited for other reasons 



& : member of the same patent family, conesponding"' 
document 



16 



EP 1 332 948 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 03 GO 0010 



This annex lists the patent famify members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

31-03-2003 



Patent document 


Publication 


Patent family 


Publication 


cited in search report 


date 


member(s) 


date 



JP 11208420 A 03-08-1999 NONE 



US 5957232 


A 


28-09-1999 


JP 
JP 


3182508 B2 
10287261 A 


03-07-2001 
27-10-1998 


EP 1170171 


A 


09-01-2002 


JP 
EP 


2002019557 A 
1170171 A2 


23-G1-20O2 
09-01-2002 



tn 

2 

I 

2 

p 

u For more details about this annex : see Official Journal of the European Patent Office, No. 1 2/82 



V 



17 



THIS PAGE BLAH.t (uspto) 



